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@ Method and system for embedding machine readable digltsri data in grayscale images. 


@ The present invention provides a system and 
method for unobtrusivety embedding machine 
readable digital data of many diffierent types in 
grayscale images for a wide variety of different 
purposes. To accomplish that, digital data is 
written into such an image by means of a low 
contrast modulation of the grayscale density of 
background portx)ns and/or certain foreground 
features of the images, suitably at a spatial 
frequency and a nKxlulatk>n contrast that caise 
the resulting grayscale modulatbn of the image 
to fall below the perceptual threshold of the 
ordinary observer wfK> views the image from 
rKirmal viewing distance. The foreground feat- 
ures that are amenable to having digital data 
encoded in them are those that nominally have 
a substantially uniform grayscale density over 
an appreciable area, such as alphanun^eric 
characters and hatftone dot patterns, as well as 
unrformty shaded lines and blocks. 
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This invention relates generally to psychophysi- 
cally improved techniques for embedding nnachine 
readable digital data in grayscale images and, more 
particularly, to a method and system for unobtrusively 
encoding machine readat>le data In hardcopy prints of 
such images. 

Grayscale printing processes have been 
developed for producing hardcopy renderings of 
scanned-in and computer generated synthetic 
images. For example, the Fuji Xerox SCATT printer 
employs a thermal sublimation process for printing 
grayscale digital Images containing up to 256 levels of 
gray at a resolution of 254 spots/inch (s.p.i.). 

Polychromatic imaging (sometimes simply refer- 
red to as "color imaging") is becoming increasingly 
important and comnrwnplace for digital image proces- 
sing applications. It therefore, is to be understood 
that the present invention can be utilized for embed- 
ding digital data in printed renderings of polychroma- 
tic grayscale images, typically by employing multiple 
iterations of the same data encoding process for iden- 
tically encoding the data in each of the color sepa- 
rations that are provided to produce such renderings. 
However, in the interest of simplifying this disclosure 
the following discussion wil concentrate on the mono- 
chromatic case. 

Others have recognized that the functional utility 
of plain paper and other types of hardcopy documents 
can be enhanced significantiy if the human readat>le 
information that they normally convey is supplemen- 
ted by adding appropriate machine readable digital 
data to them. This digital data can be recovered by 
existing input scanners, so the data can be employed 
for various purposes during the electronic processing 
of such docunfYonts and their human readat)le con- 
tents by electronic docunnent processing systems, 
such as electronic copiers, text and graphic image 
processing systems, facsimile systems, electronic 
mail systems, electronic file systems, and document 
and character recognition equipment 

As is known, machine readable digital data can 
be recorded by writing two dimensional marks on a 
recording niedium in accordance with a pattern which 
encodes the data either by the presence or absence 
of nrtarics at a sequence of spatial locations or by the 
presence or absence of mark related transitions at 
such locations. The bar-like codes which others have 
proposed for recording digital data on paper utilize 
that type of encoding. See US Patent No. 4,692,603 
on "Optical Reader for Printed Bit-Encoded Data and 
Method of Reading Same," US Patent No. 4,728,783 
and US Patent No. 4,754,127 on "Mettiod and 
Apparatus for Transforming Digitally Encoded Data 
into Printed Data Strips," and US Patent No. 
4,782,221 on "Printed Data Stiip Including Bit-Enco- 
ded Information and Scanner Contrast." Another 
interesting approach is to encode machine readable 
digital data in the shapes of tiie marics or "glyphs" that 


are written on tfie recording medium. 

Some of the recent work in this field has focused 
on the printed appearance of the codes that are 
employed for emt>edding digital data in hardcopy 

5 docunr^ents. For example, it has t>een shown that 
glyph shape codes can be designed to have a more 
or less uniform grayscale appearance. However, 
there still is a need for even less obtrusive codes for 
encoding digital data on hardcopy documents. 

10 An object of the present invention is to provide a 
nnethod and system for unobtrusively embedding 
machine readable digital data in grayscale images. 

Accordingly, the present invention provides a 
system for embedding binary data in a grayscale 

15 image tiiat is defined a set of grayscale image sam- 
pies that have various grayscale values, character- 
ised in ttiat said system includes a grayscale 
nxxjulator for nrKKlulating selected ones of saki image 
samples in accordance with sakl binary data to 

20 superimpose a low contrast binary nrxxiulation on sakl 
selected image samples, said selected image sam- 
ples having constant nominal grayscale values ttiat 
are modulated in accordance witii said binary data; 
and a grayscale printer coupled to said modulator for 

25 printing a hardcopy rendering of said Image in res- 
ponse to said image samples, ttiereby embedding 
said binary data in sakl hardcopy. 

The present invention also provkies a method for 
emt>edding binary data in a hardcopy rendering of a 

30 grayscale image that is defined by a set of image sam- 
ples of varying grayscale value, characterised in that 
said method includes selecting image samples for at 
least one spatially contiguous portion of said image 
that are of constant nominal grayscale value; mod- 

35 ulating the grayscale values of sakl selected image 
samples in accordance with said binary data to cause 
said selected image samples to swing back and forth 
between near neighboring grayscale values at a pre- 
determined frequency as a functnn of said binary 

40 data; and printing said hardcopy rendering of said 
image in response to said image samples, including 
said selected samples. 

In various embodiments the digital data is written 
into such an image by means of a low contrast modu- 

45 lation of the grayscale density of background portions 
and/or certain foreground features of the images, suit- 
ably at a spatial frequency and a modulation contrast 
that cause the resulting grayscale modulation of the 
image to fall bek>w ttie perceptual threshold of the 

50 ordinary observer who views tiie image from normal 
viewing distance under normal illumination condi- 
tions. The foreground features that are amenak)te to 
having digital data encoded in them in accordance 
with this invention are those that nominally have a 

55 substantially unifonrn grayscale density over an 
appreciable area, such as alphanumeric characters 
and halftone dot patterns, as well as uniformly shaded 
lines and blocks. 


2 


EP 0 493 091 A1 


The invention will be described further, by way of 
example, with reference to the accompanying draw- 
ings, in which:- 

Fig. 1 is a simplified block diagram of a grayscale 
Innaging system that embodies the present inven- 
tion; 

Fig. 2 is an enlarged grayscale image that has 
digital data encoded in its foreground and back- 
ground in accordance with an abnormally high 
contrast implementation of this invention; 
Fig. 3 is an enlarged grayscale image of an 
alphanumeric character that has its ASCII calling 
code embedded in it, again at an abnonnriatly high 
contrast to provide a visible presentation of the 
grayscale modulation; and 
Fig. 4 is a curve Slustrating the perceptual 
threshold and the sensitivity of a normal human 
adult observer, who views an image at normal 
viewing distance undernormal DIumination condi- 
tions, to contrast variations occurring at different 
spatial frequencies. 

While the invention is described in some detail 
hereinbelow with specific reference to an aiustrated 
embodiment, it is to be understood that there is no 
intent to limit it to that emtxxJiment On the contrary, 
the aim is to cover all alternatives, modifications, and 
equivalents falling within the scope of the invention as 
defined by the appended claims. 

Turning now to the drawings, and at this point 
especially to Fig. 1 , there is a grayscale vnaging sys- 
tem 21 comprising a grayscale modulatCH* 22 for 
superimposing a k>w contrast binary modulation on 
certain of the grayscale image samples that are pro- 
vkled at a predetermined sample rate (by means not 
shown) to cause a more or less conventk>nal grays- 
cale printer 23 to produce a hardcopy print of a scan- 
ned-in or a computer generated synthetic grayscale 
image. As will be appreciated, the nrnxJulation of the 
image samples for preselected foreground and/or 
background portions of the inriage in accordance with 
binary data causes the printer 23 to correspondingly 
HKxjulate the grayscale of the selected portions of the 
printed inrrage, thereby embedding the binary data in 
the printed image. In keeping with this invention, how- 
ever, the contrast and spatial frequency of this nrxxlu- 
lation are selected to prevent the nruidulation from 
nnaterially detracting from the perceived quality of the 
printed image (i. e., the modulation that is performed 
by the modulator 22 causes the grayscale sample 
values that are applied to the printer 23 to swing back 
and forth between near neighboring gray scale levels 
as a function of the binary data). Indeed, as described 
in some additional detail hereinbelow, the contrast 
and spatial frequency of the binary nrKKJulation of the 
image preferably are selected to cause the nrxxlu- 
lation to fall below the perceptual threshold of an ordi- 
nary observer who views the printed image at normal 
viewing distance. 


As illustrated, the binary data that is to be embed- 
ded in the printed Image is loaded (by means not 
shown) into a buffer 25 that is toggled into and out of 
operation by a control signal for serially applying the 

5 binary data to the nnodulator 22 at a predetermined 
clock frequency in timed synchronism with the image 
samples for the portions of the image in which it is des- 
ired to embed the binary data. The modulator 22 oper- 
ates in a standby nrKxie to pass unaltered grayscale 

10 image samples to the printer 23 whenever the control 
signal is at a folse ("0^ level. But when the con- 
trol signal is at a true ("1 ") logic level, an AND gate 26 
gates cfock pulses to the buffer 25 at a predetermined 
frequency, thereby causing the buffer 25 to serially 

15 apply the binary data to the nnodulator 22 at the dock 
frequency. The dock frequency for the buffer 25 is 
selected to be an integer multiple of the rate at which 
image samples are applied to the printer 23 to permit 
reliable recovery of the binary data. As a general rule, 

20 the spatial resolution of the printer 23 also is taken into 
account while selecting the dock frequency for the 
buffer 25 to cause the binary data to be embedded in 
the printed image at a desired spatial frequency. 
Various techniques may be employed for 

25 synchronizing the modulator 22 with the printer 23. 
For example, rf a page description language (PDL) 
decomposer (not shown) is empfoyed for generating 
the grayscale image samples for the printer 23 from 
a PDL encoding of the document that is to be printed, 

30 the PDL decomposition of the document may be 
analyzed (by means not shown) to identify the mage 
samples that correspond to preselected, uniformly 
toned foreground features or background areas of the 
documenL Alternatively, the grayscale image sanv 

35 pies may analyzed (by means not shown) to Mentify 
sequences of Vhite" (background) or "black" 
(uniformly toned foreground at the upper end of the 
grayscale range) samples In excess of a predeter- 
mined run length. 

40 Likewise, the digital data tiiat is embedded in the 

printed image may take several forms. For instance, 
the embedded data could encode a PDL description 
of the document, preferably using a spatially distri- 
buted, redundant encoding so that a "dean copy" of 

45 document could be reconstructed from a printed copy 
that has t»een marked-up, stained, or even partially 
destroyed. Or, altamative incarnations of a document, 
such as foreign language translations of it, may be 
dig itally embedded in a printed copy of the document 

50 Similarly, digitized sound or speech could be digitally 
recorded In a printed document FurthemrKm, this 
invention may be employed to digitally embed hyper- 
text or hypermedia pointers in hardcopy prints of 
grayscale documents. Moreover, digital signatures, 

55 copy authorization codes, editing histories, and even 
encrypted messages could all be digitally embedded 
in such grayscale prints. 

Fig. 2 niustrates a relatively simple grayscale 
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image that has digital data embedded in Its foreg- 
round and t>ackground in accordance with an emt)o- 
dtment of the invention. The contrast of the digital 
modulation of this image has been exaggerated for 
illustrative purposes, but it will be seen that this embo- 
diment may be utilized for emt>edding digital data in 
any nominally unifomily gray fbneground or back- 
ground area of a grayscale print that significantly 
exceeds the spatial resolution of the printer 23 (Fig. 
1). Fig. 3 shows, again in exaggerated contrast form, 
the use of an embodiment of the present invention for 
encoding the ASCII calling code for an alphanumeric 
character In the printed representation of the charac- 
ter (in this instance, the code is oriented vertically with 
respect to the character). As will be appreciated, 
embedded ASCII calling codes may t>e used In lieu of, 
or as an error ejection mechanism for, standard 
character recognition techniques for transforming 
printed alphanumeric text t>ack into the electronic 
domain. 

Turning now to Fig. 4, the contrast sensitivity 
function descrit>ed by Robert Sekular et al., A Cofv 
temporary Approach to Form Perception, Alfred F. 
Knopf, Inc., N. Y., N. Y, 1 985, p. 155 leads to the con- 
clusion that grayscale variations of less than about 
1 J2% that occur at a spatial frequency of at least about 
127 cycles/inch (or, in terms of printer resolution, 
about 254 s. p. i.) fall t>6low the perceptual threshold 
of an ordinary observer who views a grayscale irruige 
at a nonmal viewing distance of 14 inches. This 
suggests that binary data can be sut>-perceptually 
encoded in a grayscale image that is printed by a 256 
gray level printer by restricting the modulation con- 
trast to three or fewer grayscale levels. However, 
crosstalk t)etween closely adjacent pixels and/or 
other printer anamolies may require the use of a lower 
spatial frequency for writing the digital data into the 
printed image. Thus, It is notable that such a printer 
may sub-perceptually embed digital data in a printed 
image at a spatial frequency as low as about 63 
cycles/inch (126 s. p. i.) if the modulation contrast is 
limited to be less than about 0.045% (i. e., about one 
level out of 256). 

In view of the foregoing, it now will t>e understood 
that the present invention provides a method and sys- 
tem for unobtrusively embedding digital data of vari- 
ous descriptions in grayscale hardcopy prints of 
scanned-in and computer generated synthetic 
images, thereby enhancing tiie functionality of such 
prints. It also wfll be appreciated, that the spatial fre- 
quency and the nrK3dulation contrast at which the digi- 
tal data is embedded in such images are selected to 
prevent the embedded data from materially degrading 
the perceived quality of the printed image. Indeed, it 
will be evident that state of the art grayscale printere 
have sufficient grayscale resolution for sub-perceptu- 
ally encoding digital data into the Innages tiiey print 


Claims 

1. A system (21) for embedding binary data in a 
grayscale image that is defined a set of grayscale 

5 image samples that have various grayscale 

values, characterised in that said system (21) 
includes a grayscale modulator (22) for nKxlulat- 
ing selected ones of said image samples in 
accordance with said binary data to superimpose 

10 a low contrast binary modulation on said selected 
image samples, said selected image samples 
having constant nominal grayscale values that 
are nrKKlulated in accordance with said binary 
data; and a grayscale printer (23) coupled to said 

15 modulator (22) for printing a hardcopy rendering 
of said inr^e in response to saki image samples, 
thereby emt>edding said binary data in said 
hardcopy. 

20 2. A system (21) as claimed in Claim 1, character- 
ised in that at least some of said selected vnage 
samples define background characteristics of 
said image. 

25 3. A system (21) as daimed in daim 1, character- 
ised in that at least some of sakJ selected image 
samples define a foreground feature of said 
image. 

30 4. A system (21) as daimed in Claim 3, character- 
ised in that other of saki selected image samples 
define background characteristics of said image. 

5. A system (21) as dainied in any one of Claims 1 
35 to 4, characterised in that the nrxxiulation of said 

selected image samples is reproduced by said 
printer (23) at a contrast and spatial frequency 
that cause said nrK>duiation to be Imperceptible to 
a nonmal observer who views said hardcopy ren- 
40 dering at normal viewing distance under normal 
illumination. 

6. A method for embedding binary data in a 
hardcopy rendering of a grayscale image that is 

45 defined by a set of image samples of varying 
grayscale value, characterised in that said 
method indudes selecting image samples for at 
least one spatially contiguous portion of said 
image that are of constant nominal grayscale 

50 value; modulating the grayscale values of said 
selected image samples in accordance with said 
binary data to cause said selected image sanv 
ples to swing back and forth between near 
neighboring grayscale values at a predetenmined 

55 frequency as a function of said binary data; and 
printing said hardcopy rendering of said image in 
response to said image samples, Induding said 
selected samples. 
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7. A method as claimed in Claim 6, characterised in 
that at least some of said selected image samples 
define background characteristics of said image. 

8. A method as claimed in Claim 7, characterised in 5 
that at least some of said selected image samples 
define a foreground feature of said Image. 

9. A method as claimed in Claim 8, characterised in 

that other of said selected inr^e samples define io 
background characteristics of said image. 

10. A method as claimed in any one of Claims 6 to 9, 
characterised in that the nfX>dulation of said selec- 
ted image samples is reproduced by said printer is 
(23) at a contrast and spatial frequency that 
cause said nx>dulation to be imperceptible to a 
normal observer who views said hardcopy ren- 
dering at normal viewing distance under normal 
illumination. 20 
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